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METHOD AND APPARATUS FOR QUEUE MANAGEMENT 

5 PRIORITY 

This application claims priority from United States Provisional Application 

60/137,082 entitled "Apparatus and Method of Design and Configuration of Active 
Queue Management in Routers and Switches" filed on June 2, 1999 which is 
incorporated by reference herein in its entirety. 

10 

FIELD OF THE INVENTION 

The invention generally relates to networks and, more particularly, the invention 
relates to the management of a queue at a node in a network. 

1 5 BACKGROUND OF THE INVENTION 

Congestion occurs in a network when resource demands exceed capacity. In 
prior art communications networks, resource demands exceed capacity when data is sent 
on a path from a sender to a recipient and a node on the path cannot send data as quickly 
as it is received. In this case, the throughput of the node decreases and may drop to zero. 

20 When the throughput drops at the node, received packets build up in the node's 

memory, referred to as a buffer, increasing the number of accumulated packets forming a 
queue until the buffer is full and overflows. As the buffer overflows, data at the receiver 
may be delayed or the data may be lost. Such a state is generally a transient condition in 
a network as users of the network vie for resources during peak time periods. In the past, 

25 nodes in high-speed networks have been forced to include large buffers in an attempt to 
avoid overflow during periods of congestion. As a result of increasing buffer size, 
defined as accumulated packets waiting to be serviced, the average queue size increases. 
The average queue size for a buffer is the average number of packets present in the 
buffer. 

30 One technique for avoiding large queues and large network delays is Random 

Early Detection (RED). RED is designed to accompany transport-layer congestion 
control protocols such as TCP and operates as a mechanism for regulating the amount of 
information that is sent to a node by decreasing the number of acknowledgment packets 
that are sent to the sender. The congestion control mechanism in TCP is a closed control 
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system that reacts to unacknowledged packets by re-sending the unacknowledged 
packets and reducing the transmission rate. Systems that implement RED detect 
congestion by computing the average queue size as data is received into a buffer. When 
the average queue size exceeds a preset threshold, the node refuses to service i.e. "drops" 
5 a percentage of packets as determined by a control function. 

The queue sizes determined by the RED technique, in combination with TCP 
congestion control, are subject to large size oscillations. Using the RED technique, 
parameters defining the control function are set by a system's administrator, without a 
methodology for determining values for the parameters. As such, the control function 

10 may be unstable and fail to adequately regulate the feedback to the TCP congestion 
control. The large oscillations that result under such circumstances in one node can 
propagate to other nodes and cause erratic behavior in the network. Because RED does 
not define a methodology for calculating the parameters, system administrators have 
used trial and error techniques. These trial and error techniques do not provide for a 

15 controllable network. 

SUMMARY OF THE INVENTION 

A method, apparatus, and computer program product for determining a drop 
probability for use in a congestion control module located in a node in a network are 
disclosed. A weight value for determining a weighted moving average of a queue in a 

20 node is first systematically calculated. The weighted moving average is calculating and 
an average queue size for the node is determined based upon the weighted moving 
average. A control function associated with the congestion control module is evaluated 
using the average queue size to determine the drop probability. The weight value may be 
calculated by first determining a sampling period for measuring the queue size. Next, a 

25 time period for which samples significantly contribute to the average queue size is 
calculated. The weight is determined based upon the sampling period and the time 
period. In a further embodiment, the control function is calculated based upon a queue 
function where the queue function is calculated based upon predetermined system 
parameters. The control function may be selected based upon a queue policy for 

30 management of the queue. From the queue policy a threshold value which lies along the 
queue function curve is determined. This point provides a minimum value for the 
maximum point of the control function so as to avoid oscillations within the buffer. A 
maximum point may then be selected which resides outside of the curve for the queue 
function. The control function may then be selected so that the control function crosses 
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through the maximum point. Thus, when the congestion control module drops packets 
based upon the drop probability determined by the control function the queue will not 
oscillate. 



5 BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects and advantages of the invention will be 
appreciated more fully from the following further description thereof with reference to 
the accompanying drawings wherein: 

Fig. 1 shows a schematic drawing of a communications network in which the 
10 apparatus and method for queue management may be implemented. 

Fig. 2 is a flow chart for determining the steady state operating point of a queue. 

Fig. 3 shows a simplified network, which is used to simulate a more complex 
communications network. 

Fig. 4 is a block diagram showing another simplification of the network where 
15 the network is reduced to a single-flow feedback system. 

Fig. 5 is a sample plot of the queue law function. 

Fig. 6 is a graphical representation of the queue law function and the control 
function in which the axes are the average queue size and the drop percentage. 

Fig. 7 is a graphical representation of a control function. 
20 Fig. 8 is a graphical representation showing two control functions superimposed 

upon the queue law function. 

Fig. 9 is a graphical representation of the ranges that the queue law function may 
take based upon the values for the number of flows, the size of a packet, and the round 
trip transmission time. 

25 Fig. 10 shows a flow chart of the steps used by either a designer of a congestion 

control module or of a system administrator setting the parameters for defining the 
control function of the congestion control module. 

Fig. 1 1 is a flow chart showing the steps taken in calculating the point (q max , 

Pmax). 

30 Fig. 12 is a flow chart showing the steps taken in calculating the minimum buffer 

size. 

Fig. 13 is a block diagram of another embodiment of a congestion control module 
containing a processor and a queue estimator. 

Fig. 14 is a flow chart of the method used in calculating the value of the 



weight,w. in a queue estimator 

Fig. 15 is a graphical representation of the sending rate verses time for an 
exemplary communications network. 

Fig. 16 is an alternative embodiment of a congestion control module in which the 
5 queue law is used for long term adjustment of the drop probability. 

Fig. 17A shows an illustrative configuration module. 

Fig. 17B shows a control function module that resides within a congestion 
control module. 

Fig. 18A shows a weight calculation module. 
10 Fig. 1 8B shows a congestion control module which is similar to the congestion 

control module of Fig. 13, but Fig. 18B also shows the data which is necessary for 
configuring the congestion control module prior to operation. 

DESCRIPTION OF SPECIFIC EMBODIMENTS 

15 Fig. 1 shows a schematic drawing of a communications network in which the 

apparatus and method for queue management may be implemented. The communications 
network, such as the Internet, connects computers and other processing devices to other 
computers, servers, and processing devices via nodes so that data may be sent, received, 
and retrieved. All devices that forward and filter data, such as, but not limited to, 

20 routers, bridges, b-routers, switches, repeaters and gateways will be referred to as nodes 
in the following description and claims and all connections between such nodes shall be 
referred to as links. 

In the following description and appended claims the term "flow" shall refer to a 
signal representative of data sent from a sending node to a receiving node. In the 

25 description and the claims the term "capacity" refers to the total amount of data that a 
link can process in a given time and is equivalent to line speed. 

Nodes within the network each have at least one ingress and one egress port. A 
node may receive multiple flows of data, usually in the form of packets, into one or more 
of the ingress ports where each flow is stored and queued in a buffer prior to routing the 

30 data flow to an egress port in the node. As more information flows into the buffer, the 
queue becomes larger until the capacity of the buffer is reached and then the subsequent 
data is lost. To prevent buffer overflow, the buffer of each node is regulated by a node 
congestion control module that operates in conjunction with an end-system congestion 
control module. The node congestion control module regulates the average queue size by 



indicating to the sending node that congestion is occurring at the receiving node. The 
end-system congestion control module refers to the part of the transport layer protocol 
that is responsible for adjusting the sending rate at the sending node. For example, in a 
network employing TCP as the transport layer protocol, the node congestion control 
5 module drops acknowledgement packets to indicate congestion and the end-system 
congestion control module decreases the sending rate in response. In another example, 
the node congestion control module may send an acknowledgement packet from the 
receiver indicating that congestion is occurring and again the end-system congestion 
control module decreases the sending rate at the sending node. It will be understood by 

10 those of ordinary skill in the art, that any end-system congestion control module may be 
used which causes a sending node to adjust its sending rate as the result of congestion. 
Additionally, the node congestion control module would be designed to work in 
conjunction with the chosen end-system congestion control module. For the remainder of 
this disclosure, the end-system congestion control module will refer to an embodiment in 

15 which TCP is the transport layer protocol. This is done for exemplary purposes and is in 
no way meant to limit the scope of the disclosed invention. 

In a TCP environment, when packets of data are dropped, the node does not send 
an acknowledgment packet to the sending node. As a result, the sending node slows 
down its sending rate, which has the effect of decreasing the size of the average queue in 

20 the buffer of the receiving node. As stated before, the average queue size is the average 
amount of data found in the node's buffer. The average queue size shall be represented 
by q. The interaction between the node congestion control and the end-system congestion 
control has the effect of stabilizing the node's queue size and the rate it drops packets. 
The values of average queue size and drop probability in such a stable or steady state are 

25 referred to collectively together as a steady-state operating point. 

In a node that incorporates a congestion control module and implements one 
embodiment of the invention for queue management, the steady-state operating point can 
be calculated based on the solution for a system of two equations. The two equations 
being a queue law function and a control function. Fig. 2 shows a flow chart for 

30 determining the steady-state operating point. First the queue law is evaluated (step 210). 
This first function represents a characterization of the end-system's congestion control . 
In other words, the queue law function is an approximation of the average queue size of 
an exemplary queue in a node based upon the traffic characteristics and the percentage of 
dropped packets. For example, one embodiment of the queue law equation that will be 



further explained and derived below can be: 
G(p) = min^c^'^c/n)-^)) 
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Next the control function is determined (Step 220). The control function is 
characteristic of the node congestion control module. It determines the drop percentage 
when the buffer of the node is filled above a predetermined threshold based upon an 

10 average queue size as an input parameter. The control function may be any type of 

function, but is preferably a linear function. The point of intersection between the queue 
law function and the control function determines a value to which the drop percentage 
should be set and the control module uses the drop percentage to drop packets evenly 
across all flows (step 230). 

15 The queue law may be used in variety of ways for the design, configuration, and 

operation of a congestion control module. In one embodiment, the congestion control 
module may be enabled to calculate both the queue law and the control function based 
upon input data concerning traffic characteristics, and determine the point of intersection 
of the functions thus determining the packet drop rate. In another embodiment, the queue 

20 law may be used to model the queue variation for a node over all drop probabilities 

based upon maximum and minimum traffic conditions. This modeling of the queue can 
aid a system administrator in determining configuration parameters for the control 
function of the congestion control module of a node in a network in order to avoid 
oscillations in the queue. In such an embodiment, a predefined control function exists in 

25 the congestion control module that has a definable shape, and the queue law provides 
information for configuring the shape so that the system remains stable. In yet another 
embodiment, the modeling of the queue law based upon the expected maximum and 
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minimum traffic conditions can be used to define a range of operation for a node. The 
ranges of operation can then be used in the design of a node to determine the minimum 
buffer size. 

The derivation of the queue law function is shown in the next two figures. Fig. 3 
5 shows a network that is used as a model for determining the queue law for a complex 
communications network. The network of Fig. 3 is a simplification of a real network 
such as the Internet. In this simplified network, the transport layer protocol is TCP. The 
simplified network is used to determine a queue law function for a node based upon 
known traffic characteristics for the node, such as, the line speed, number of TCP flows 
10 and propagation delay. The queue law function determines an average queue size for a 
buffer based upon a drop percentage, where the drop percentage is an independent 
variable. 

In the simplified network, a node congestion control module is situated in node 
B. The communications system acts as a feedback control system in which the control 
15 module is the sending node, the controlling element is the node congestion control 
module, the feedback signal is the drop percentage, and the controlled variable is the 
sending rate. A total of n flows, from node Aj through node A n> flow into node B, which 
contains a node congestion control module. Node B is connected to node C through a 
single link. 

20 One function/operation of the node control module is to maintain the cumulative 

data rate of all flows below or equal to the link's capacity so that the rate of the 
combined flows from node B, i.e. the throughput, is less than or equal to the capacity of 
the link between B and C. The throughput of a TCP flow is dependent on the drop 
percentage p, the average round trip time R, the average packet size M, the average 

25 number of packets acknowledged in one acknowledgement message b, the maximum 

congestion window size advertised by the flow's TCP receiver W max , and the duration of 
the basic TCP timeout T D . The throughput of a TCP flow is approximately equal to 

M — - £ , if W(p)<W 

M — t — r otherwise 

r *L w + ±^ + 2 ) + 2 {p > W ™ )F{p)T ° 
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where 



w> = m j^-a-py)(L + &-p^-(L--pr))] 

F(/?) = l+p + 2/? 2 + 4/? 3 +8p 4 +16p 5 +32p 6 

5 

which was derived in Padhye, Firoiu, Towsley and Kurose A Stochastic Model of TCP 
RENO congestion Avoidance and Control Technical Report CMPSCI TR-99-02 
University of Massachusetts, Amherst 1999 which is incorporated by reference herein in 
its entirety. 

10 For discussion purposes, the assumption is made that all links into node B and 

out of node C have enough capacity. Accordingly, the link between B and C is the only 
link where congestion can occur. All n flows combine at the buffer of node B and each 
flow provides digital data that adds to the queue. One simplification of the model 
network that is used to determine the queue law function assumes that there is only one 

15 link between two nodes. Additionally, packets of data are assumed to flow in only one 
direction. In Fig. 3 data flows from nodes Ai. n to nodes Di_ n . The only data that flows in 
the other direction is assumed to be acknowledgment packets (ACKs). Further, the 
number of flows into node B is assumed to remains constant. Assuming that all flows 
have the same average round trip time and the same average packet size and that the 

20 maximum congestion window size is so large that it does not influence the throughput, 
the network may be reduced to a single-flow feedback system as shown in Fig. 4. 

Based on aforementioned assumptions, the queue law =G(p) is determined 
(where is the average size of the queue and p is the drop probability). Since the link 
between A and B is the only possible point of congestion, the average round trip time of 

25 a packet is the sum of the average waiting time in the queue of node B and Ro, the 

propagation and the round-trip transmission time outside the node. Assuming a FIFO 
(First and First Out) queuing scheme, the average waiting time in the queue is q/c and 
the overall round trip time for a packet is the sum of the average waiting time in the 
queue and the propagation and transmission time on the rest of the round trip so that 

30 R=R 0 +q/c. 

Regulating the queue due to congestion is only relevant when the link is fully 
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utilized, since the average queue size is small otherwise. The link utilization can be 
determined through the following calculation: 



cl n 

5 The link utilization u(p) takes values between 0 (not utilized) and 1 (fully utilized). If it 
is determined that the link is fully utilized, the queue law function for providing the 
average queue size is: 

G(p) = c(T- 1 {p,c/n)-R Q ) 
where c is equal to the line speed and Tr ^p^) is the inverse of T(p,R) in R, i.e., 
10 T R 4 (p,T(p,R)) = R. Since the average queue size cannot exceed the size of the buffer 
B, the queue law is: 

G(p) = max(s, cfa 1 (p, c/n)-R Q )) 



15 



20 



25 



A sample plot of the queue law function is provided in Fig. 5. It should be 
understood by those skilled in the art that additional simplifications may be made that 
result in different equations for the utilization and the average queue size. For example, 
if the system is assumed to be free of TCP timeouts, the throughput T(p,R) can be 
approximated as 

R V 2bp 



and thus it can be easily shown that: 

G(p) = max 



B t nM 



-cR n 



if the link is fully utilized, i.e., if u(p)=l where 

. = nM HT~ 
~ cR 0 \ 2bp 

The resulting queue law equation can be programmed into a processor or programmed in 
software to be executed or embedded into an electronic chip associated with the node 
congestion control module for automatic calculation during operation of the node based 
upon traffic conditions. Traffic conditions include the line speed c and the round trip 
time R, the number of flows, n, and the throughput or all variables necessary to calculate 
the throughput. For example, the minimum and maximum throughput per flow (x^ x ma J 
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which for a dial-up modem in a wide area network is 28.8Kb/s for x mm and 56Kb/s for 
T nun however the speed of x mm and x max the connection is implementation dependent. 
Additional traffic characteristics include the minimum and maximum packet sizes (Mmi„, 
M max ) the minimum and maximum round trip time outside of the queue (Romin, Romax) the 
5 minimum and maximum drop probability outside of the queue (pomin, pomax) and the 
minimum and maximum TCP receiver window ((W max ) min, (W max ) max ). 

Fig. 6 shows a graphical representation of the queue law function and the control 
function in which the axes on which the functions are graphed are the average queue size 
(Y- axis) and the drop percentage (X-axis). The two functions are each dependent on 

10 one variable that is the product of the other function and as a result, both functions 

intersect at a point. This intersection point is the expected equilibrium for the node based 
on the initial traffic conditions. The equilibrium point provides the drop percentage for 
the congestion control module so that data packets may be dropped as the data enters the 
buffer of the node to regulate the queue size. By dropping packets based upon a 

15 percentage of packets entering the node, each flow is proportionally affected regardless 
of the sending rate of the particular flow. 

Fig. 7 is a graphical representation of the control function H(q) = p. In an 
exemplary embodiment, the control function is composed of two linear segments. The 
first linear segment, segment A, defines the expected operational range of the average 

20 queue size. The segment is selected to be linear for ease of design and management as a 
control system, although a non-linear segment can be substituted. The maximum point of 
the first segment defines the maximum expected values for the average queue size and 
the corresponding drop rate (# m ax, pmax) when the node is under normal operating 
conditions, i.e. there is not an unexpected change in any of the traffic conditions. For 

25 example, if a node normally handles up to 1000 simultaneous flows, and traffic 

conditions change producing 100,000 flows, such a scenario would cause the node to 
operate in overload outside of the normal operating conditions. The second linear 
segment, segment B, defines the overload operation range for the average queue size. 
This segment is preferably designed with a steeper slope as shown in Fig. 7, but does not 

30 have an infinite slope, as an infinite slope creates a discontinuity and possible 

uncontrollable oscillations to the average queue size. The steeper slope of segment B 
allows the queue to degrade gracefully to its normal operational range along Segment A. 
Segment B is defined by points (qmax, pmax) and (gclip, 1) where gclip is defined, as 
shown in Fig. 7, as the average queue size at which there is a one hundred percent drop 



rate. It should be understood that segment B, like segment A, may be non-linear in 
shape. 

Although the intersection point is the point of convergence for the average queue 
size, the communications network may encounter various changes that affect the queue 
5 law and cause fluctuations affecting the average queue size of the node. These transient 
fluctuations are normal in complex communications networks and the queue average will 
eventually return to the equilibrium point if the system is stable. If the maximum value 
of the control function on segment A (g max , Pmax) lies below the equilibrium point and 
thus inside of the queue law function, the transient behavior of the system is unstable 

10 causing the queue size to fluctuate in an oscillatory pattern. The average queue size can 
oscillate between empty and full buffer, causing the packet drop percentage to vary 
between zero and 100%. As packets are dropped and the sending rate of the sending 
node varies, a similar state can occur in the queue of the sending node. As such, the 
oscillations may reverberate throughout the communications network. 

15 Fig. 8 shows two control functions superimposed upon the queue law function. In 

control function A the expected maximum value (p max , <7max) for the control function lies 
above the equilibrium point and therefore outside of the queue law function, allowing the 
transient response of the system to decay so that the oscillations of the system dissipate 
and the system returns to the equilibrium point. The maximum value (p m ax, <?max) of 

20 control function B is shown to be below the equilibrium point and therefore inside the 
queue law function which results in the average queue size fluctuating causing 
oscillations in the queue and throughout the communications network. 

It should be understood by those skilled in the art that the queue law can have 
various curves depending on the input values of n, the number of flows, M, the average 

25 packet size, and R, the average round trip time. As shown in Fig. 9 by the shaded region, 
the queue law may take on any value within this region dependent upon the values for n, 
M, and R. If the control function is originally set to control function A pictured in Fig. 9 
and the queue law curve is originally G m in, the system is stable at initialization and large 
fluctuations do not occur in the average queue size. If the parameters n, M, and R change 

30 to their maximum, maximum, and minimum values respectively during the course of 
operation of the node, the queue law curve would then become G max , and the control 
function A would have transients which would cause average queue size fluctuation. If in 
contrast, the control function is set initially to control function B of Fig. 9, no matter how 
n, M, and R vary over the course of operation of the node, the equilibrium point is 



always maintained inside the queue law curve and all transients dissipate and the system 
settles at the equilibrium. 

Fig. 10 shows a flow chart of the steps used by either a designer of a congestion 
control module or by a system administrator setting the parameters for defining the 
5 control function of the congestion control module. First, the value of G max is calculated 
(step 1000). Using the calculated value G max> a designer or system administrator of a 
congestion control module for a node, can design the control function so as to avoid 
oscillations by designating the maximum point of the control function, as defined by 
(Pmax, <7max), outside the maximum queue law curve G max (step 1010). The designer or 

10 system administrator can then define the control function to be any function with 

expected operating range ending at (pmax, <?max) outside of G max (step 1020). The function 
may already be defined as in a congestion control module which uses RED, and as such a 
system administrator only needs to input parameter values including (p ma x, g m ax) so that 
step 1020 is unnecessary. The designer or system administrator may add a further 

15 segment to the control function which is defined between (pmax, q m ax) and the maximum 
buffer size # c ii P which also defines the point at which there is a 100 percent packet drop 
rate. 

It should be understood that a computer program can be created for a node 
designer for determining allowable values for the maximum point of the control function 
20 as defined by the intersection of the queue law function and the control function based 

upon expected ranges of traffic conditions for the node. Further this program need not be 
part of a congestion control module and may be used offline during the design phase of a 
node. 

The actual value for (g max , p m ax) as explained above may be any value that lies 
25 outside of the queue law function. However, to fix a value for (^ max , pmax), one of the 
two variables must be known and the other variable calculated as shown in the flow 
chart of Fig. 11. Determining (i?max, pmax) is accomplished by first selecting a policy for 
queue management. For example, the policy can be a drop conservative or delay 
conservative policy, but other policies can be used (step 1 100). If the drop conservative 
30 policy is selected, pm^ is set by the designer or system administrator (step 1 1 10). If the 
delay conservative policy is selected dmax, the maximum allowable delay, is set by the 
designer or system administrator (step 1115). For a drop conservative policy, given Pmax 
, the condition to avoid oscillations becomes ^ max >G max (p max ) providing a formula for 
fixing ^max (step 1 120). Since ^r max defines the maximum average queue size, this 
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threshold may be increased by 20% to account any spikes in the average buffer size so 
that 4max>l-2G max (p max ). It should be understood by those of ordinary skill in the art, that 
the 20% added is used for exemplary purposes and that any value greater than G max (p ma x) 
may be used for determining and avoiding perturbations. As such, the maximum 
5 value for the control function can be set. For a delay conservative policy, a value for d max 
is given, thus <? m ax=d ma x c (step 1 125). Finally, pmax may be determined by applying 
Pmax > G^maxOjmax) (step 1130). As with the drop conservative policy, oscillations may be 
avoided by adding in a factor of 20% such that p^ =1.2 G" 1 raa x(^max)- Again this 20% is 
used for exemplary purposes and any value greater than the threshold of G A max (q max ) for 

10 calculating p max may be used. 

The queue law function can also be used to determine the minimum needed 
buffer size, B for operation in a network environment having a defined set of maximum 
traffic conditions in a fashion similar to the method described with respect to Fig. 11. 
Fig. 12 shows a flow chart of the steps taken in calculating the minimum buffer size. 

15 First, a maximum traffic condition is selected (step 1200). The maximum traffic 

condition is selected based upon the desired policy for queue management. If a drop 
conservative policy is chosen, a low drop probability is desired and the maximum drop 
percentage pm^ is known. If a delay conservative policy is chosen, a low average queue 
size is desired and a value for the maximum allowable delay d max is known. The 

20 maximum queue law function G raax is used to determine the minimum buffer size # max 
based upon the known traffic condition (step 1210). For the drop cons, policy and for the 
delay conservative # m ax = dmax c and Pmax > G^maxtemax). The buffer size of the planned 
node is set to any value equal to or above the value for the maximum average queue size, 
q max (step 1220). In a preferred embodiment the buffer size is substantially larger than 

25 the maximum average queue size by an order of two in order to account for fluctuations. 
In another embodiment of the invention for operation in a node in a 
communications network, the congestion control module contains a processor to 
implement a control function and a queue estimator that computes the average queue 
size, which is shown in Fig. 13. A congestion control module receives as input the 

30 average queue size and outputs the drop percentage p. The node congestion control 

module of Fig. 13 implements a feedback node control function p=H(g e ) for adjusting 
the average queue size of the node, where q e is an estimate of the long-term average of 
the queue size for a node. In such an embodiment the queue law may be used to 
determine the shape of the control function as explained with respect to Fig. 10 and 1 1 
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and the minimum buffer size as explained with respect to Fig. 12. The parameters of the 
control function are preferably set in the node congestion control module by a system 
administrator. For example, if the congestion control module is a RED implementation, 
the values of (^min, Pmin) (^max, Pmax) and q c \\ v are input to define the control function. The 
5 control function may have any shape and is not limited to the shape as defined by the 
RED implementation. 

The congestion control module receives data flows from a plurality of sources 
into an input. From the input, the data is placed into a buffer. As the buffer is filled with 
data, a queue is created. The position of the data within the buffer is tracked by a pointer 
10 that is controlled by a processor. The average queue size is calculated by a queue 
estimator and is then used to determine the drop percentage based upon the control 
function. The drop percentage is then used to drop packets within the queue, which 
slows down the sending rate evenly across all flows and as a result adjusts the average 
queue size. 

15 The queue estimator is essentially a low -pass filter on the instantaneous queue 

size, which filters out brief queue changes and estimates the long-term queue average. In 
a preferred embodiment, an exponentially weighted moving average is used to calculate 
the average queue size. The average queue size is determined by first taking samples of 
the queue size every 6 seconds over a given time period, I, and exponentially weighting 

20 the averaging process by a weight factor, w. The average in the exponentially weighted 
moving average is calculated recursively based on previous average and a new sample 
q k so that q k+ i = wq k +(l-w)^ lt . To calculate the exponentially weighted moving average a 
value for the weight, w is necessary. The value for w is determined based upon the 
values of 6 and I. 

25 Fig. 14 shows a flow chart of the method used in calculating the value of the 

weight w. First, a value for 6 is determined. It, 6, can be as small as possible, but is 
limited by implementation constraints. (Step 1400). The value of 6 should be at most 
Romin, which is the minimum round trip time for a packet, since the throughput of a TCP 
flow can only change rates based on a packet being sent and an acknowledgment either 

30 being received or not being received. As such, the queue size will not change with any 
significance in less than a round trip. A value defining when a sample's contribution is 
negligible is determined (Step 1410). In an exponentially weighted moving average, the 
contribution of each sample decreases exponentially with each passing time interval 5 
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Therefore, the number of samples which contribute with any significance to the average 
may be calculated assuming a weight smaller than a value, a, which defines the point at 
which the sample's contribution is negligible. The value of a is between 0 and 1 and is 
typically assumed to be 0.1 or 1/e = 0.367. Knowing that, the number of samples, m, that 
5 contribute with any significance to the average may be calculated: 

\n(a) 
ln(l - w) 

where the total time interval for all of the samples, I, may be substituted based on the fact 
that I=mo , and therefore, w=l-a 6/I . 

10 A value for I is then calculated (STEP 1420). The value of I is determined as the 

result of two opposing conditions for affecting the exponentially weighted moving 
average. The first condition is to provide an acceptable approximation of the long-term 
average of the system assuming a constant number of flows, wherein the approximation 
accurately accounts for small perturbations in the instantaneous average. The second 

15 opposing condition for the queue averaging algorithm is the ability of the approximation 
to account quickly for changes to the system such as a substantial increase in the number 
of flows using the following assumptions of the network, which provides a compromise 
between the two conditions is found. In a communications network that has n flows 
flowing into a node which have the same average round trip time, the throughput of each 

20 flow is x=c/n and each flow has the same drop rate p. Additionally, it is assumed that the 
network implements a TCP congestion control algorithm in which the sending rate 
decreases when a packet is not acknowledged. In such a network, the sending rate over 
time is linearly increasing for a flow until a packet is dropped, when the rate is then 
decreased in half as shown in Fig. 15. The period of this function is denoted by P. The 

25 variation in sending rate is reflected in a similar variation in the queue size and thus the 
queue size has the same periodicity P. If the averaging interval of the moving average is 
equal to the period, then the average is equal to the long term average and the value does 
not change when the interval is translated in time. If the interval is smaller than the 
period I<P, then the average is no longer constant. For I>P, the moving average has a 

30 small variation, but converges rapidly to the long-term average. 

P can then be determined as a function of average drop rate p and average round 
trip time R: 
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P = A(p,R) = 



^wj P ) + iy ^ w MMK if w(p)<Wt 

p_ +2 ) + Qip^Mp)ro 



otherwise 



1-p 

Since P is a function of p and R, P can take multiple values depending on traffic 
conditions. For the purpose of ensuring the stability of the control system, I is taken to 
be the maximum value of P over all traffic conditions n, M, R, Wmax, within the 
predefined range n^n, n max , Mmi n , M max , R^, Rmax, W maxmin , W maxmax . I is chosen to be 
the maximum value of P so that the smaller intervals which produce averages with high 
variation can be accounted for. I is computed as follows: 

/ - max(A(/7 1 , R 0 max + q l /c), A(p 2 , R 0mRX + q 2 I c)) 
where A is defined above and 



10 (pi,<?i) is the solution to 



qi = G^pO 

pi = H(#i) and 



(p2,<?2) is the solution to 

<?2 = GmaxCpi) 

15 p 2 = H(g 2 ) 

The weight can then be calculated such that w=l-a 6/1 (Step 1430). From the value of the 
weight w, the long term average of the queue size can be calculated using the 
exponentially weighted moving average described above. The long term average queue 
size is then passed from the queue estimator to the processor, which uses the queue size 

20 to determine the drop probability for the node. 

In yet another embodiment as shown in Fig. 16, in which a queue estimator and 
control function are used to provide congestion control in real-time for a node, the queue 
law may be used to periodically correct the location of the queue in the buffer. In such an 
embodiment, the queue law function is calculated on a periodic basis in a queue law 

25 module based upon input traffic conditions, which are sensed by sensors attached to the 
node housing the congestion control module. The queue law module may be part of a 
processor for calculating the control function or a separate processor. From the queue 
law function, the expected operation point may be calculated by finding the intersection 
of the queue law function with that of the control function of the congestion control 

30 module. The operation point, can then be compared to either the instantaneous queue 
size or an estimated moving average based upon instantaneous queue samples. If the 



instantaneous queue size or the estimated moving average is larger than the estimated 
queue size, the drop probability is increased to reduce the sending rate and if the queue 
size is smaller than the estimated queue size the drop probability is decreased so that the 
sending rate increases. In such an embodiment, the average queue size is adjusted to the 
5 estimated value the queue law function provides a means for compensating for drift in 
the queue, which may result from the queue estimator. 

It should be understood by those of ordinary skill in the art that the method for 
defining the control function and thus (pmax, ^max), the method for defining the minimum 
buffer size and the method for determining the weight may be combined for determining 

10 RED parameters in a systematic manner. These RED parameters may then be entered by 
a system administrator for use in a RED congestion control module. Further, if the RED 
congestion control module requires a value for 8 the method for calculating 6 may also 
be part of the method for systematically determining the RED parameters. 

Fig. 17 A shows an illustrative configuration module in which system parameters 

15 as defined above are input into a configuration module and the disclosed methods for 
determining (p max , <7max ) and the buffer size are implemented. The output of the module 
which is control function configuration parameters may then be used by a system 
- administrator to configure a control function module which resides within a congestion 

control module as shown in Fig. 17B. The control function configuration parameters of 

20 the buffer size and the maximum point of the control function (pmax, #max ) are used in 
combination with the desired queue policy to define the control function. Once the 
control function is defined the control function module can receive the average queue 
size as input and will then output the drop probability for the node containing the control 
module. Fig. 18 A shows a weight calculation module that receives as input system 

25 parameters and at an intermediary stage determines the sampling period and the number 
of samples that significantly contribute to the average queue size. This weight calculation 
module may be part of the congestion control module or a completely independent 
module. The weight calculation module then uses the number of samples and the 
sampling period to determine a weighting value, which is then used for estimating the 

30 average queue size. Fig. 18B shows a congestion control module which is similar to the 
congestion control module of Fig. 13, but Fig. 18B also shows the data which is 
necessary for configuring the congestion control module prior to operation. As shown in 
Fig. 18B the weight is necessary for the queue estimator and the control function 
configuration parameters are necessary for the configuration of the control function 
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which is part of the control function module. 

In an alternative embodiment, the disclosed method and apparatus for queue 
management may be implemented as a computer program product for use with a 
computer system. Such implementation may include a series of computer instructions 
5 fixed either on a tangible medium, such as a computer readable medium {e.g., a diskette, 
CD-ROM, ROM, or fixed disk) or transmittable to a computer system, via a modem or 
other interface device, such as a communications adapter connected to a network over a 
medium. The medium may be either a tangible medium {e.g., optical or analog 
communications lines) or a medium implemented with wireless techniques {e.g., 

10 microwave, infrared or other transmission techniques). The series of computer 

instructions embodies all or part of the functionality previously described herein with 
respect to the system. Those skilled in the art should appreciate that such computer 
instructions can be written in a number of programming languages for use with many 
computer architectures or operating systems. Furthermore, such instructions may be 

15 stored in any memory device, such as semiconductor, magnetic, optical or other memory 
devices, and may be transmitted using any communications technology, such as optical, 
infrared, microwave, or other transmission technologies. It is expected that such a 
computer program product may be distributed as a removable medium with 
accompanying printed or electronic documentation {e.g., shrink wrapped software), 

20 preloaded with a computer system {e.g., on system ROM or fixed disk), or distributed 
from a server or electronic bulletin board over the network {e.g., the Internet or World 
Wide Web). Of course, some embodiments of the invention may be implemented as a 
combination of both software {e.g., a computer program product) and hardware. Still 
other embodiments of the invention are implemented as entirely hardware, or entirely 

25 software {e.g., a computer program product). 

Although various exemplary embodiments of the invention have been disclosed, 
it should be apparent to those skilled in the art that various changes and modifications 
can be made which will achieve some of the advantages of the invention without 
departing from the true scope of the invention. These and other obvious modifications 

30 are intended to be covered by the appended claims. 
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I claim: 

1. A method for determining a drop probability, the method comprising: 

systematically calculating a weight for determining a weighted moving average 

of a queue in a node; 

calculating the weighted moving average; 

determining an average queue size based upon the weighted moving average; 
and 

evaluating a control function using the average queue size to determine the drop 
probability. 



2. The method according to claim 1, wherein systematically calculating a weight 
comprises: 

determining a sampling period for measuring the queue size; 

determining a time period for which samples significantly contribute to the 

average queue size; and 

determining the weight based upon the sampling period and the time period. 

3. The method of claim 1, wherein determining a control function comprises: 
determining a queue function based upon predetermined system parameters; and 
determining the control function based upon the queue function. 



4. The method according to claim 3 wherein determining the control function 
further comprises: 

selecting a queue policy; 

determining a threshold value based upon the selected queue policy 
determining a maximum point based upon the threshold value, wherein the 
maximum point is outside of the queue function 

selecting the control function such that when the control function is evaluated a 
point passes through the maximum point. 



5. The method according to claim 4 wherein the queue policy is a delay 
conservative 

policy and wherein determining a threshold value comprises: 

determining a maximum value for the average queue size. 
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6. The method according to claim 4 wherein the queue policy is a drop conservative 
policy and wherein determining a threshold value comprises: 

determining a maximum value for the drop probability. 

5 

7. A method for reducing oscillations in queue size in a link using congestion 
control that operates in a TCP environment, the method comprising: 
determining a queue law function defining the average size for a link based at 
least upon the variable of drop probability; 

10 defining a control function which determines the drop probability based upon the 

average queue size wherein a bounding point for the control function defining a 
maximum value of drop probability and a maximum value of the average queue 
size is greater than an equivalent point on the queue law function for either the 
maximum value of the average queue size or the maximum value of the average 

15 drop probability; and 

dropping packets from the queue based upon a packet drop rate defined at a point 
of intersection for the control function and the queue law function. 

8. The method according to claim 7, wherein in the step of defining the control 
20 function, the control function is further defined as a function having no discontinuities. 

9. The method according to claim 7, wherein the function is piecewise linear. 

10. A method for increasing utilization of a link capable of receiving a number of 
25 flows into a buffer, the link residing in a TCP network, the link having a congestion 

control module which drops packets to avoid buffer overflow, the method comprising: 

determining a quantity representative of a capacity for the link; 
calculating a quantity representative of the throughput for the link; 
30 determining the utilization based on the capacity of the link, the throughput of the 

link, the numbers of flows and a packet drop probability; and 
adjusting the packet drop probability to increase the utilization of the link. 



11. A method for congestion control in server having a queue which resides in a 
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network wherein each data transmission from a sender to a receiver is sent at a 
transmission rate and the data transmission is acknowledged by the receiver, 
wherein if the data transmission is not acknowledged by the sender reduces the 
transmission rate, the method comprising: 

ascertaining a network function which represents an average queue size of the 
queue based upon a server drop rate; 

determining a control function for the server which produces an average queue 
size based upon a given server drop rate; 

calculating an equilibrium point based upon the intersection of the network 
function and control function; and 

setting the drop rate of the server to the equilibrium point. 

An apparatus for determining a drop probability, the apparatus comprising: 
a buffer for receiving data into a node forming a queue; 
a weight module for systematically calculating a weight for determining a 
weighted moving average of the queue in a node; 

a queue estimator for calculating the weighted moving average based on the 
weight and the received data in the queue and determining an average queue size 
based upon the weighted moving average; and 

a processor for evaluating a control function using the average queue size to 
determine the drop probability. 

The apparatus according to claim 12, wherein the weight module: 
determines the weight by first accessing a sampling period for measuring the 
queue size and a time period for which samples significantly contribute to the 
average queue size. 

The apparatus according to claim 12, further comprising: 
a configuration module for determining a queue function based upon 
predetermined system parameters and determining the control function based 
upon the queue function. 

An apparatus for reducing oscillations in queue size in a link using congestion 
control that operates in a TCP environment, the method comprising: 
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a queue law module for determining a queue law function based on system 
parameters defining the average queue size for a link based at least upon the 
variable of drop probability; 

a control function module defining a control function which determines the drop 
probability based upon the average queue size wherein a bounding point for the 
control function defining a maximum value of the drop probability and a 
maximum value of the average queue size is greater than an equivalent point on 
the queue law function for either the maximum value of the average queue size or 
the maximum value of the average drop probability; and 
a processor for dropping packets from the queue based upon a packet drop rate 
defined at a point of intersection for the control function and the queue law 
function. 

An apparatus for reducing oscillations in queue size in a link using congestion 
control that operates in a TCP environment, the apparatus comprising: 
a configuration module for systematically determining control function 
configuration parameters based upon traffic characteristics; 
a control function module receiving the control function configuration parameters 
which define a control function and receiving an estimated queue size, the 
estimated queue size used in conjunction with the defined control function to 
determine a drop probability; and 

a processor for dropping packets from the queue based upon a packet drop rate. 

A computer program product for determining a drop probability, wherein the 
computer program product has computer code on a computer readable medium, 
the computer code comprising: 

computer code for systematically calculating a weight for determining a weighted 
moving average of a queue in a node; 

computer code for calculating the weighted moving average; 

computer code for determining an average queue size based upon the weighted 

moving average; and 

computer code for evaluating a control function using the average queue size to 
determine the drop probability. 
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18. The computer program product according to claim 17, wherein the computer 
code for systematically calculating a weight comprises: 
computer code for determining a sampling period for measuring the queue size; 
computer code for determining a time period for which samples significantly 
5 contribute to the average queue size; and 

computer code for determining the weight based upon the sampling period and 
the time period. 

The computer program product according to claim 17, wherein the computer 
code for determining a control function comprises: 

computer code for determining a queue function based upon predetermined 
system parameters; and 

computer code for determining the control function based upon the queue 
function. 

The computer program product according to claim 19 wherein the computer code 
for determining the control function further comprises: 
computer code for selecting a queue policy; 

computer code for determining a threshold value based upon the selected queue 
policy computer code for determining a maximum point based upon the threshold 
value, wherein the maximum point is outside of the queue function 
computer code for selecting the control function such that when the control 
function is evaluated a point passes through the maximum point. 

25 21. The computer program product according to claim so wherein the queue policy is 
a delay conservative policy and wherein the computer code for determining a 
threshold value comprises: 

computer code for determining a maximum value for the average queue size 

30 22. The computer program product according to claim 21 wherein the queue policy is 
a drop conservative policy and wherein the computer code for determining a threshold 
value comprises: 

computer code for determining a maximum value for the drop probability. 



19. 

10 



15 

20. 
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23. A computer program product for reducing oscillations in queue size in a node 
using congestion control that operates in a TCP environment, wherein the computer 
program product has computer code on a computer readable medium, the computer code 
comprising: 

5 computer code for determining a queue law function defining the average queue 

size for a link based at least upon the variable of drop probability; 
computer code for defining a control function which determines the drop 
probability based upon the average queue size wherein a bounding point for the 
control function defining a maximum value of the drop probability and a 

10 maximum value of the average queue size is greater than an equivalent point on 

the queue law function for either the maximum value of the average queue size or 
the maximum value of the average drop probability; and 
computer code for dropping packets from the queue based upon a packet drop 
rate defined at a point of intersection for the control function and the queue law 

15 function. 

24. The computer program product according to claim 23, wherein in the computer 
code for defining the control function, the control function is further defined as a 
function having no discontinuities. 

20 

25. The computer program product according to claim 23, wherein the function is 
piecewise linear. 

26. A computer program product for increasing utilization of a link capable of 

25 receiving a number of flows into a buffer, the link residing in a TCP network, the link 
having a congestion control module which drops packets to avoid buffer overflow, 
wherein the computer program product has computer code on a computer readable 
medium, the computer code comprising: 

computer code for determining a quantity representative of a capacity for the link; 
30 computer code for calculating a quantity representative of the throughput for the 

link; 

computer code for determining the utilization based on the capacity of the link, 
the throughput the link, the number of flows and a packet drop probability; and 
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computer code for adjusting the packet drop probability to increase the utilization 
of the link. 

27. A computer product for congestion control in a server having a queue which 
resides in a network wherein each data transmission from a sender to a receiver is sent at 
a transmission rate and the data transmission is acknowledged by the receiver, wherein if 
the data transmission is not acknowledged the sender reduces the transmission rate, 
wherein the computer program product has computer code on a computer readable 
medium, the computer code comprising: 

computer code for ascertaining a network function which represents an average 

queue size of the queue based upon a server drop rate; 

computer code for determining a control function for the server which produces 
an average queue size based upon a given server drop rate; 
computer code for calculating an equilibrium point based upon the intersection of 
the network function and control function; and 

computer code for setting the drop rate of the server to the equilibrium point. 
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ABSTRACT OF THE DISCLOSURE 

A method, apparatus, and computer program product for determining a drop 
probability for use in a congestion control module located in a node in a network is 
disclosed. A weight value for determining a weighted moving average of a queue in a 
5 node is first systematically calculated. The weighted moving average is calculating and 
an average queue size for the node is determined based upon the weighted moving 
average. A control function associated with the congestion control module is evaluated 
using the average queue size to determine the drop probability. The weight value may be 
calculated by first determining a sampling period for measuring the queue size. Next, a 

10 time period for which samples significantly contribute to the average queue size is 
calculated. The weight is determined based upon the sampling period and the time 
period. In a further embodiment, the control function is calculated based upon a queue 
function where the queue function is calculated based upon predetermined system 
parameters. The control function may be selected based upon a queue policy for 

15 management of the queue. From the queue policy a threshold value which lies along the 
queue function curve is determined. This point provides a minimum value for the 
maximum point of the control function so as to avoid oscillations within the buffer. A 
maximum point may then be selected which resides outside of the curve for the queue 
function. The control function may then be selected so that the control function crosses 

20 through the maximum point. Thus, when the congestion control module drops packets 
based upon the drop probability determined by the control function the queue will not 
oscillate. 

115003 
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Section 365(b) of any foreign application(s) for patent or inventor's certificate, or Section 365(a) of 
any PCT International application which designated at least one country other than the United States, 
listed below and have also identified below, by checking the box, any foreign application for patent or 
inventor's certificate or PCT International application having a filing date before that of the application 
on which priority is claimed. 

Prior Foreign Application(s) Priority Not Claimed 



(Number) (Country) (Day/Month /Year Filed) 

□ 

(Number) (Country) (Day/Month/Year Filed) 

_____ □ 

(Number) (Country) (Day/Month/Year Filed) 
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I hereby claim the benefit under 35 U.S.C. Section 119(e) of any United States provisional 
application(s) listed below: 



60/137,082 


June 2, 1999 


/Annlir*Qtinn Cariol Mrs \ 
\M[jpiluc4UUn oclial \\Q.) 


(Filing Date) 


(Application Serial No.) 


(Filing Date) 



(Application Serial No.) (Filing Date) 



I hereby claim the benefit under 35 U. S. C. Section 120 of any United States application(s), or 
Section 365(c) of any PCT International application designating the United States, listed below and, 
insofar as the subject matter of each of the claims of this application is not disclosed in the prior 
- United States or PCT International application in the manner provided by the first paragraph of 35 
U.S.C. Section 112, I acknowledge the duty to disclose to the United States Patent and Trademark 
Office all information known to me to be material to patentability as defined in Title 37, C. F. R., 
Section 1 .56 which became available between the filing date of the prior application and the national 
or PCT International filing date of this application: 



(Application Serial No.) 


(Filing Date) 


(Status) 






(patented, pending, abandoned) 


(Application Serial No.) 


(Filing Date) 


(Status) 






(patented, pending, abandoned) 


(Application Serial No.) 


(Filing Date) 


(Status) 






(patented, pending, abandoned) 



I hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and the like so made are punishable by 
fine or imprisonment, or both, under Section 1001 of Title 18 of the United States Code and that such 
willful false statements may jeopardize the validity of the application or any patent issued thereon. 
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POWER OF ATTORNEY: As a named inventor, I hereby appoint the following attorney(s) and/or 
agent(s) to prosecute this application and transact all business in the Patent and Trademark Office 
connected therewith, (list name and registration number) 



Bruce D. Sunstein 
Robert M. Asher 
Timothy M. Murphy 
Steven G. Saunders 
Harriet M. Strimpel 
Samuel J. Petuchowski 
Jeffrey T. Klaynian 
John J. Stickevers 
Herbert A. Newborn 
Elizabeth P. Morano 
Jean M. Tibbetts 



Reg. No. 27,234 
Reg. No. 30,445 
Reg. No. 33,198 
Reg. No. 36,265 
Reg. No. 37,008 
Reg. No. 37,910 
Reg. No. 39,250 
Reg. No. 39,387 
Reg. No. 42,031 
Reg. No. 42,904 
Reg. No. 43,193 



Jay Sand vos 
Sonia K. Guterman 
Keith J. Wood 
Mary M. Steubing 
Christopher J. Cianciolo 
Lindsay J. McGuinness 



Reg. No. 43,900 
Reg. No. 44,729 
Reg. No. 45,235 
Reg. No. 37,946 
Reg. No. 42,417 
Reg. No. 38,549 



Send Correspondence to: John J - Stickevers 
- Bromberg & Sunstein LLP 

f- 125 Summer Street 

; f Boston, MA 02110 

^ Direct Telephone Calls to: (name and telephone number) 
% John J. Stickevers at (617) 443-9292 



Full name of sole or first inventor 




Victor Firoiu 




Sole or first inventor's signature 


Date 


Residence 




14 Bedford Village, Apartment A, Bedford, MA 01730 




Citizenship 




U.S.A. 




Post Office Address 




Same as residence 







Full name of second inventor, if any 
Marty Borden 

Second inventor's signature ~~ Date" 



Residence 

30 Shaker Lane, Littleton, MA 01460 

Citizenship 

U.S.A. 

Post Office Address 
Same as residence 
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